Testing the Collective Properties of Small- World Networks through Roughness Scaling 
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Motivated by a fundamental synchronization problem in scalable parallel computing and by a 
recent criterion for "mean-field" synchronizability in interacting systems, we study the Edwards- 
Wilkinson model on two variations of a small-world network. In the first version each site has 
exactly one random link of strength p, while in the second one each site on average has p links of 
unit strength. We construct a perturbative description for the width of the stationary-state surface 
(a measure of synchronization), in the weak- and sparse-coupling limits, respectively, and verify the 
results by performing exact numerical diagonalization. The width remains finite in both cases, but 
exhibits anomalous scaling with p in the latter for d < 2. 

PACS numbers: 89.75.Hc, 89.20.Ff, 68.35. Ct 



Crossovers from low-dimensional to mean-field-like be- 
havior have been studied and found in various interact- 
ing systems 0, 0, 0, S 0] when the (original) regular and 
short-range interaction topology is modified to a small- 
world (SW) network [(JOllS- Mean- field behavior is com- 
monly observed, even when the random links are added 
to a one-dimensional original "substrate" 0, 0, • Re- 
cently, a general criterion for the crossover to mean-field 
behavior was given by Hastings |l| . 

The equilibrium Edwards- Wilkinson (EW) model 
(considering it as the (f 1 Gaussian model at the continu- 
ous phase transition) is a particularly interestingcase in 
that it does not satisfy the mean-field criterion |9( when 
each pair of sites is connected with probability p/N with 
a link of unit strength on top of a one- dimensional regu- 
lar substrate. Thus, the EW model on this SW network 
is expected to display drastically different scaling prop- 
erties (as a function of p) than the mean-field version of 
the model in one dimension. In this paper we address 
this question. 

The scaling properties of the EW model on regu- 
lar or random networks have direct relevance to the 
scalability and synchronizability of parallel discrete- 
event simulations (PDES)[lJ [l|. In PDES schemes 
the individual processing elements (PE) generate their 
own time streams for update attempts (local simulated 
times) [T3.ll4j . The synchronization/communication be- 
tween neighboring PEs (following the interaction topol- 
ogy of an underlying short-range interacting system with 
asynchronous dynamics) leads to Kardar-Parisi- Zhang 
(KPZ)-like kinetic roughening [lil flf^ of the simulated 
time horizon [TH Il7| . For a one-dimensional chain or 
ring of PEs, the steady-state performance of the PDES 
scheme is governed by the EW Hamiltonian . In par- 
ticular, for N PEs, the width of the simulated time hori- 
zon diverges as iV 1 / 2 , seriously hindering efficient data 
collection and state saving |l2j, |l8j . Since scalable data 



management crucially depends on the finiteness of the 
width of the time horizon (the spread of the progress 
of the individual PEs), one must suppress the diverging 
fluctuations of the simulated time horizon. As an al- 
ternative to costly and frequent global synchronizations 
among the PEs, an autonomous small- world synchroniza- 
tion scheme was demonstrated to work 01 • This finding 
provided another concrete example for synchronizability 
in generalized multi-agent systems facilitated by a small- 
world network 0, . 

Motivated by both the generic scaling properties of 
SW networks, and also the specific applications to scal- 
able PDES synchronization schemes, we will consider two 
different variations of a the EW model on a SW network. 
In the "soft" and frequently studied version of the SW 
network, random links of unit strength are added to the 
one-dimensional substrate with probability p/N to each 
pair of sites 0, 120I l2l| . In the "hard" version, each site 
has exactly one random link (in addition to the nearest- 
neighbors) and the strength of the interaction through 
the random links is p. That is, pairs of sites are selected 
at random, and once they are linked, they cannot be 
selected again. The latter construction originates from 
scalable PDES schemes, where fluctuations in the indi- 
vidual connectivity of the PEs are to be avoided ^3 • We 
introduced the above terminology for the two versions of 
the network in regard to the eigenvalue spectrum of the 
respective coupling matrix [2]]], discussed at the end. 

We consider the equation (for a single realization of 
the small world) 

N 

d t hi = -(2h i -h i+ i-h i -i)-22 Jij(hi-hj)+rn(t) , (1) 

where h t is the surface height, rji{t) is a delta-correlated 
Gaussian noise with variance 2 (without loss of gener- 
ality), and we have dropped the i-dependence from the 
argument of hi for brevity. The symmetric matrix Jy 
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a) Hard network: 

b) Soft network: 



FIG. 1: Diagrams for the calculation of the Green's function 
and the self-energy. 



represents the quenched random links on top of a one- 
dimensional lattice of length N with periodic bound- 
ary conditions. For the hard version of the small world 
Jij has exactly one non-zero element (being equal to p) 
in each row and column. This construction results in 
Yli Jil = P f° r a ^ For t ne soft version of the small 
world, each element of Jy (e.g., above the diagonal) is 
1 with probability p/N and zero otherwise. In this case 
E; Ju\ — Vi where [. . .] denotes the average over the 
network disorder, i.e., the average coordination number 
is p. We write Eq. (JIJ as dthi — — J2j ^ijhj + r)i, where 
r = r° + V. Here, r° is the Laplacian of the original 
one-dimensional ring, while Vij = — Jij + <% Yli Jn IS ^ ne 
Laplacian on the random part of the network. 

In this Letter we focus on the behavior of the width, 
which probes the generic collective properties of the un- 
derlying networks by providing a sensitive measure of 
synchronization \l2\ . For a given realization of the small- 
world network the average surface width characterizing 
the roughness is equal to 
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where h—(l/N) hi i s the mean height, (. . .) denotes 
an ensemble average over the noise in Eq. (|TJ , and are 
the non-zero eigenvalues of the real symmetric coupling 
matrix T. Our numerical scheme relied on the exact di- 
agonalization [z| of the coupling matrix T for a given re- 
alization of the network, and then we exploited the right 
side of Eq. J5J) to obtain the width. Finally, we obtained 
the disorder- averaged (denoted by [...]) width [(w 2 )jv] 
by averaging over a large number of (ranging from 100 
to 1000) realizations. 

To motivate the results that follow, we consider the 
role of dimension d for the EW model on the soft version 
of the network, along the lines of Ref . • As an approxi- 
mation to the soft network, consider instead an alternate 
model, where in addition to the nearest-neighbor con- 
nections, each site is coupled to all others with strength 



p/N . This yields the trivial (inhomogeneous Landau) 
mean-field behavior with the mass p [23j and the cor- 
responding correlation length £ ~ p -1 / 2 , and a correla- 
tion volume £ d ~ p~ d / 2 . Now, let us check if this model 
is a valid description of the soft network. For the soft 
network, within this volume one would have on average 
p£, d ~ p x ^ d l 2 links. For d>2 this number diverges as 
p— >0; then for small p there are a large number of links 
leaving the volume and the sample-to-sample fluctuation 
in the mass in a correlation volume is negligible compared 
to the mass itself so that the trivial mean-field behavior 
is expected to be valid. For d<2, the trivial behavior 
breaks down as we will see in a perturbative calculation. 
In contrast, for the hard version of the network the den- 
sity of random links is unity, and the trivial mean-field 
scaling is expected to hold for all d in the p^0 limit. 

The same result can be obtained by using the general 
criterion [t| in terms of the critical exponents for the 
correlation length and for the susceptibility, v and 7, re- 
spectively. When viewed as a model near a continuous 
phase transition, the EW model has v=l/2, 7=1. The 
criterion vd/2 + 7/2 > 1 for the validity of mean-field 
behavior is thus violated for d=l, while d=2 is marginal. 

We define the propagator G to be equal to in the 
space of non-zero eigenvalues of T, while G vanishes when 
acting on the zero mode of T. Thus, G = P(T + ie)" 1 , 
where Py = Sij — 1/N is the projector onto the vec- 
tor space orthogonal to this zero mode. We now present 
the results of a perturbative approach for the disorder- 
averaged propagator [G], using techniques of impurity 
averaged perturbation theory [24j . leaving details to be 
published elsewhere 25] . The perturbative expansion of 
[G] can be obtained by [G] = G° - [G°VG] = G° - 
[G°VG°] + [G°VG°VG°] - where G°=P(T° + ie)" 1 
is the propagator of the Laplacian on the original one- 
dimensional lattice. To obtain [G] it is necessary to av- 
erage this expansion over the network disorder in V. 

To deal with only one-particle irreducible disorder- 
averaged diagrams, we calculate the self-energy E = 
([G])" 1 - (G°) _1 perturbatively for both the soft and 
hard versions of the small-world. In Fig. ^ a single line 
denotes the propagator G° while a double line denotes 
[G]. The relation between [G], G°, and E is shown at the 
top of the figure. In these calculations, a cross with no 
dashed lines attached is used to denote the average over 
different realizations of the network of a diagonal term 
Vu in V. A pair of crosses connected by a dashed line is 
used to denote an average [VuVjj] — [Vu][Vjj], while three 
or more crosses connected by dashed lines are used to 
denote higher cumulants. Similarly, circles connected by 
dashed lines are used to denote averages of off-diagonal 
terms — Jij in V. Dashed lines can connect both circles 
and crosses. Terms in the expansion with a circle, not 
connected by dashed lines to other circles, vanish as 1/N 
for large N and so may be neglected. For the hard net- 
work, terms in the expansion with two or more crosses 



2 



1C 



§ 10 1 



10" 




nN= 1000 (hard) 
♦ N=2000 (hard) 
A N=4000 (hard) 
-B N=1000 (soft) 
-O N=2000 (soft) 
-A N=4000 (soft) 



10 



FIG. 2: Disorder-averaged width obtained by exact numerical 
diagonalization for the hard (filled symbols) and for the soft 
(open symbols with dashed lines to guide the eye) version of 
the small world as a function p for system sizes indicated in 
the figure. The two slopes indicate the asymptotic small-p in- 
finite system-size behavior. The solid lines are obtained using 
the finite-system propagator with the effective mass Eq. © 
for the hard network. 



connected by dashed lines vanish since there are no ran- 
dom fluctuations in 5ij Ja in this case, while for the 
soft network these terms do appear. In the hard net- 
work, each power of V comes with a power of p, while in 
soft network, each set of circles or crosses connected by 
dashed lines comes with a power of p. 

In the hard version of the network, we can proceed 
by expanding [G] in powers of V. The first diagram in 
Fig.QJa) yields the lowest order result E = p. Adding the 
second diagram yields £ = p — p 2 [G]u — p — p 2 /(2\/E), 
where we use the fact that, for large N, [G]u = l/(2\/E) 
plus terms of order (see, e.g., [26;]). Inserting the 
leading order result for S into the second diagram we 
find 



Shard =P~ (1/2) p 
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so that the higher powers of V lead to corrections to £ 
which are higher order in p as required. 

In the soft version of the network, the above procedure 
does not work. The first diagram in Fig.^b) yields £ = 
p. Inserting this result for £ into the next two diagrams 
leads to £ = p—p 1 / 2 , so that the expansion in V does not 
lead to an expansion in p. To correct this, at "leading 
order" we instead sum up all diagrams involving a single 
link. The first terms in this sum are shown in the first 
pair of parenthesis in Fig.^b). The infinite sum yields 
^ = p(l-2[G}n+4[G}%-...) =p/(l+2[G}ii). Solvingthis 
equation self-consistently to lowest order in p yields £ = 
p 2 . Physically, since the density of links is small, of order 
p, this result consists of exactly solving the interaction 
with a single link. 

Having done this infinite summation, we can now con- 
sider another infinite series of diagrams (containing two 
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FIG. 3: Comparison of the numerically obtained width (sym- 
bols) for the hard version of the small-world network for 
iV=4000 with the lowest (dashed lines) and next-to-lowest 
order (solid lines) perturbative results. The inset shows a 
magnified view of the improvement of the latter. 



links), starting with the last one shown in Fig.QJb), and 
adding additional diagrams where each single interaction 
with the given link is replaced by two, three, or more 
interactions with the link, as well as diagrams in which 
crosses are replaced by circles. Let us determine the or- 
der of this summation in p. The infinite summation re- 
places the interaction with a given link with the sum: 
1 - 2[G]u + 4[G]| - ... = 1/(1 + 2[G\u) oc p. Thus, the 
diagram has four such "scatterings" , leading to a result 
of order p 4 . There is an additional factor of p 2 , due to 
the appearance of two sets of circles/crosses connected 
by dashed lines. There is a further factor of [G]^ oc p~" 3 
from the three Green's functions. Finally, there is a sum- 
mation over the spacing between the two impurities; this 
spacing is of order p~ x . As a result, this sum yields a re- 
sult which is again of order p 2 . Note that these diagrams 
lead to a self-energy Ey which is off-diagonal in real- 
space, and hence is momentum dependent; we consider 
here the zero momentum part of E. More complicated 
diagrams continue to yield results of order p 2 . As a re- 
sult, after this resummation, we are able to determine 
only that E so f t scales as p 2 , but not the exact coefficient, 
and not the higher order corrections: 



E so ft oc p 



(4) 



Then, the disorder-averaged width can be found from 
E by [(u; 2 )] = [G] u ~ ^7g- Thus, the asymptotic small- 
p behavior of the width in the thermodynamic limit is 
[(w 2 )]hard — l/(2y/p) and [(w 2 )] so ft oc 1/p, for the respec- 
tive versions of the small- world networks. These asymp- 
totic small-p, infinite system-size behaviors are indicated 
with the two slopes next to the numerical data in Fig. [2] 
In an attempt to match the behavior of the width for 
finite systems in the hard network, we used the finite- 
system version of the propagator (see, e.g., [§i(|) with the 
effective mass from Eq. (0 ■ Note that we ignored various 
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finite-size corrections to £ itself, as being too complicated 
to be worth calculating. The results lead to good agree- 
ment and are systematically improved by including the 
next-to-leading order corrections for the hard network 

(Fig. m ■ 

These results indicate that in both SW versions, the 
width approaches a finite value for any non-zero value of 
p as N—kx). In the hard network, the scaling of the width 
asymptotically approaches that of the mean-field version 
of Eq. (JJJ 23], while the soft network does not exhibit 
this scaling, as expected from the general criterion 0. 
Similarly, for g?=2, one finds Shard = V ~ • • ■) while for 
the soft case the resummation of the expansion enables 
one to find a logarithmic correction to the trivial mean- 
field behavior .25:3: 
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Sgoft = 2np/\ log(p)| 



(5) 



For d>2, E is asymptotically of order p for both soft and 
hard cases, i.e, the systems are effectively mean-field. 

We now interpret the effective mass obtained pertur- 
batively, Eqs. and (J2J, in light of earlier results. The 
density of states p(X) (the eigenvalue spectrum of the the 
coupling matrix T) has been recently investigated in the 
context of diffusion on the "soft" version of the small- 
world network [2l| • The soft construction of the network 
allows for the existence of arbitrarily long "pure" chain 
segments when the system size N goes to infinity [2l| . 
Although the probability of these quasilinear chain seg- 
ments of length I is exponentially small (~ e~ pl ), they can 
contribute to eigenvalues of order l/l 2 |2jjl2£|- Summing 
up over large I values with the exponential weight above 
yields p(X) - {l/VX)e- cp/VX for small A 21], where c is 
a constant. Thus, there is no gap in the spectrum. The 
density of states, however, vanishes exponentially fast for 
small A as a result of the essential singularity in the expo- 
nent, and one can refer to p 2 as a pseudo-gap. From the 
right side of Eq. it follows that in the iV— >oo limit, the 
disorder-averaged width can be expressed in terms of the 
density of states as [(u> 2 )] = J(l/X)p(X)d\. The small-A 
behavior of p(X) determines whether the width remains 
finite or diverges in the thermodynamic limit. The ex- 
ponentially small p(X) above more than compensates for 
the term A in the denominator yielding [(u> 2 )] so ft oc 1/p. 

Our perturbative scheme can be extended to calculate 
p(X) by defining [G(X)\ = P[{T- X + ie)- 1 ] so that p(X) = 
— Im[G(A)]/7r. For the hard version of the network, we 
expect that there is indeed a true gap of order p. The 
self-energy is only weakly A-dependent. Each site has one 
link and for any fixed segment of the chain, as N—>oo, 
there is a vanishing probability that any of these links 
connect two sites in the given segment, thus preventing 
the construction of quasilinear segments as above. 
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